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COLOR RECOGNITION OF 
RETROREFLECTIVE 
TRAFFIC SIGNS UNDER VARIOUS 
LIGHTING CONDITIONS 


by John B. Arens, A. Reza Saremi, and Carole J. Simmons 


Introduction 


Sign colors contribute substantially to correct sign 
recognition. While daytime color appearance is influ- 
enced somewhat by weather conditions (e.g., sun, 
clouds, rain, or fog) nighttime sign colors are greatly 
affected by the artificial lighting (headlamps, fixed 
sign lights, or a combination thereof) under which 
they are seen. For example, signs made from retro- 
reflective materials reflect light from headlamps back 
to the driver very efficiently. Signs made from other 
than retroreflective materials (i.e., from opaque mate- 
rials) are not adequately visible under headlights 
alone and must be illuminated by fixed lights to be 
visible at night. Fixed sign lights are also often used 
with retroreflective signs to improve the signs’ 
conspicuity and legibility. In such cases signs are 
seen under a combination of fixed sign lighting and 
headlights. Depending on the spectral distribution of 
the light produced by the various types of sign lights 
and headlamps, the chromaticity of illuminated signs 
will shift markedly at night. The present research 
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grew out of concern over possible changes in color 
appearance resulting from such chromaticity shifts as 
well as from changes in color specification. The study 
was conducted in 1990 at the Turner-Fairbank High- 
way Research Center and was sponsored by the Fed- 
eral Highway Administration (FHWA) as part of the 
Grants for Research Fellowships program. 


Background 
Color Specifications for Traffic Signs 


Color coding is used to aid drivers in the prompt 
recognition of highway signs, pavement markings, 
traffic signals, and other traffic control devices. 
The Manual on Uniform Traffic Control Devices 
(MUTCD) specifies meanings for eight colors: 


* Red—stop or prohibition. 

* Yellow—general warning. 

* Orange—construction and maintenance warning. 
* Blue—motorist services guidance. 








* Green—indicated movements permitted, direction 
guidance. 

¢ Brown—recreational and cultural interest guidance. 

* Black and white—regulatory. (7)' 


To standardize the appearance of the colors used in 
the MUTCD, the FHWA has issued color specifica- 
tions in the form of central values and tolerance lim- 
its. Historically, these specifications were based on 
the colors of available materials rather than on ex- 
perimental data on color recognition. For example, 
the acceptable region for yellow includes the rather 
orangish yellows produced by lead chromate, the 
pigment once widely used in producing yellow road 
markings. Progress in the manufacture of pigments 
and retroreflective materials may have made an im- 
proved standard highway yellow possible. 


There has been concern about possible color confu- 
sion among red, orange, and yellow sign colors, es- 
pecially at nighttime, since the FHWA specifications 
for these three colors are relatively closely spaced 
in the International Commission on Illumination 
(Commission Internationale de |’Eclairage-ClE) 
chromaticity diagram. Several recent studies have 
analyzed experimental data on the color appear- 
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Figure 1.—Spectral power distribution for incandescent 
tungsten-halogen lamp used in this study. 


ance of materials viewed under diffuse sources of 
illumination. (2,3,4) These materials included ordi- 
nary (Opaque) paints and pigments conforming to 
the American National Standards Institute’s (ANSI) 
specifications Z-53.1 as well as retroreflective 
samples conforming to FHWA specifications. (5) 
One analysis recommended that the safety color 
specifications should be considered for adoption 
in highway signing applications. (3) 


‘Italic numbers in parentheses identify references on page 7. 
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Figure 2.—Spectral power distribution for typical daylight 
(CIE 1971). 


Headlamp Types 


Currently used tungsten-halogen headlamps produce 
light with much energy in the red portion of the spec- 
trum with a related color temperature of around 
2,800 to 3,000 K (figure 1). Daylight, on the other 
hand, contains much energy in the blue portion of 
the spectrum—about 6,500 K for natural daylight 
(figure 2). Since signs (or any other object for that 
matter) can only reflect light available, their colors 
appear different under headlights than under day- 
light. Motorists are, however, accustomed to this 
much redder appearance. Within the next 2 years, 
cars will probably be produced with metal-halide 
headlamps rather than tungsten-halogen headlamps. 
The industry’s rationale for changing from tungsten- 
halogen to metal-halide is the latter lamp’s much 
higher efficiency, longer life, and smaller size (figures 
3 and 4.) The metai-halide lamp produces visible 
energy at distinct wavelengths across the spectrum 
with a good amount of blue and considerably less 
red than the tungsten-halogen lamp; its related color 
temperature is expected to be about 4,200 to 4,500 K 
(figure 5). The effect of such a change in headlamp 
spectral composition on the nighttime appearance of 
traffic signs is not yet fully known. One computational 
analysis found mixed results for the sample of High- 
Intensity Discharge (HID) spectral power distributions 
studied; there were indications that the discrimina- 
bility of red versus orange, yellow, and brown might 
actually be improved under certain HID sources as 
compared with tungsten halogen sources. (6) 


Objectives 


The main objective of the present study was to com- 
pare current FHWA standard retroreflective signing 
materials with those materials following ANSI safety 
color specifications. Specifically, the study: 
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* Compared color identification of these materials 
when viewed in the retroreflective mode (i.e., un- 
der headlighting) as well as under diffuse lighting. 


* Compared color recognition for retroreflective 
materials viewed under tungsten-halogen versus 
metal-halide simulated headlamps, either alone or 
in combination with various fixed light sources 
commonly used for sign lighting. 


Study Design 


Laboratory setup 


The laboratory setup was designed to simulate 
sign-viewing geometry for a passenger car posi- 
tioned 400 ft (121.9 m) from a traffic sign, with the 





Figure 3.—Arc-tube of proposed metal-halide automotive 
headlamp compared with a conventional tungsten-halogen lamp. 


sign 14 ft (4.3 m) to the right from the right-hand 
edge of the road and 8 ft (2.4 m) above the road 
surface (figure 6). For that geometry, the driver 
sees the sign at an observation angle of about 0.2 
degrees. The observation angle is comprised of a 
ray from the headlights to the sign and a ray from 
the sign back to the observers’ eyes. 


Twelve different retroreflective sheeting materials 
(7 yellow, 3 red, and 2 orange) from 2 manufactur- 
ers were evaluated. Since two pilot studies had 
shown no problems in color recognition of blue and 
green samples, this study was restricted to yellow, 
red, and orange. (7,8) The FHWA and experimental 
ANSI samples were included for each color. 


Since retroreflective sheeting is not commercially 


available in ANSI colors, these samples were custom 
made for use in this study. The red and orange 
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Figure 4.—Headlamp design utilizing metal-halide discharge 
lamp. 


sheetings were all FP-85 Type II (enclosed lens) mate- 
rials; the yellow sheetings included Type III (encapsu- 
lated lens) and an experimental prismatic material 
(not included in the FP-85 typology), as well as Type II 
materials. (9) See table 1 for a full description of the 
12 sheeting materials. Each of the 12 materials was 
mounted on a 1- by 2-ft (30- by 61-cm) aluminum 
panel. Black and white striping was used as a border 
along the upper and lower edges of the panels; other- 
wise, the panels were blank. 


Three types of lighting were used: simulated day- 
light, headlighting only, and a combination of 
headlighting plus fixed sign lighting. A daylight 
simulator with two spectrally correct fluorescent 
lamps of 6,500 K was used to provide the diffuse 
simulated daylight condition. 








450 200 569 600  ¢§50 
Wavelength (nm) 





Figure 5.—Spectral power distribution for metal-halide lamp 
used in this study. 
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Auto 
Headlights 


Figure 6.—Experimental design setup. 


The light sources simulating either tungsten-halo- 
gen or metal-halide headlamps had to be quite 
small to fit into a space that allowed maintenance 
of the 0.2-degree observation angle within the 50-ft 
(15.2-m) laboratory space. This size limitation pre- 
cluded the use of real headlamps. 


To simulate the tungsten-halogen headlamp, a small 
30-W tungsten-halogen narrow beam floodlamp was 
used. To simulate the metal-halide headlamp, a 70-W 
neutral white metal-halide lamp with a 3,800 K color 
temperature was used. Figure 5 shows the spectral 
power distribution for this lamp. The lamps were lo- 
cated close to the observers’ eyes (one to the left, the 
other to the right) to ensure maintenance of the 0.2- 
degree observation angle. Photometric information 
on sealed beam headlights showed an illuminance 
ievel of 0.2 lux at the sign surface. To provide this illu- 
minance level at the sign surface, neutral 

density filters were used to attenuate the luminous 
intensity of these lamps. 


For the fixed sign lighting used in combination with 
headlighting, four different light sources were used: 
clear mercury, phosphor-coated mercury, phos- 
phor-coated metal-halide, and high-pressure so- 
dium. Each of these lamp types was mechanically 
adjusted to produce about 200 lux on the sign sur- 
face with a geometry similar to that used for bot- 
tom-mounted sign lights. This level represents the 
average illuminance used for overhead guide signs. 


Each of the 12 signing materials was viewed under 
a total of 11 lighting conditions: 


* One daylight condition. 
* Two headlight type conditions. 








Traffic Sign 
(1'x2') 


Fixed Sign 


Lighting 


* Eight combination conditions: two headlight type 
conditions with each of four different fixed sign 
lights. 


Subjects 


Forty subjects participated in the study. They were 
divided among four different age groups—25 and 
under, 26 through 44, 45 through 65, and 66 and 
over. Each age group contained five males and five 
females. All subjects were licensed drivers with 
corrected visual acuity of 20/40 or better, as tested 
with a Bausch & Lomb Ortho-Rater. Subjects were 
screened for normal color vision with the Ishihara 
pseudoisochromatic plate test. (70) 


Percent correct 





Orang 
Mm FHWAsamples 2 ANSI samples 





Figure 7.—Mean correct color identification across all lighting 
conditions. 
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Experimental Procedure 


Subjects were seated on a chair of adjustable 
height and given time to adapt to the lighting con- 
ditions. Subjects were instructed to press a hand- 
held button as soon as they could identify sign 
color; they were told to use a single-word color 
term such as green, yellow, red, lime, or olive in 
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Figure 8.—Mean correct color identification under daylight and 


headlights only. 


SPEC. 


making their identification. To begin each trial, a 
single sign panel was moved into the viewing posi- 
tion; the shutter was then opened. The subject's 
color naming response and response time were re- 
corded. A within-subjects design was used in which 
each subject viewed each of the 132 stimuli (i.e., 12 
panels under each of the 11 lighting conditions). 


Data Analyses and Results 


For purposes of analysis, color naming responses 
were coded as correct if they agreed with the nominal 
color of the material; any other response was consid- 
ered incorrect even though there is no real right or 
wrong regarding a person’s perceptions. Thus, if a 
subject identified a nominally orange sample as gold, 
this was coded as an incorrect response. 


Table 1 presents the percentage of subjects re- 
sponding correctly to each color sample under each 
of the 11 lighting conditions. Figures 7 through 9 
are bar graphs based on these data. Figure 7 
shows overall means for FHWA and ANSI samples 
for each color, averaged across all 11 lighting con- 
ditions. In figure 8, the means are averaged across 
the daylight and headlights only conditions. Figure 
9 presents the means across the eight headlights 
with fixed lighting conditions. 


Table 1 —Percent correct color identification 


**Headlights Only | 


** "Headlights and Fixed Lighting 





[TYPE MEH 





FHWA 
FHWA 
FHWA 
ANSI 
ANSI 
ANSI 
ANSI 


FHWA 
ANSI 
ANSI 


FHWA 
ANSI 


u 
il 
PR 
" 
7 
PR 





Notes: 
* Types Il and Ill comply with specifications in FP-85. 


Type PR was a prismatic material not included in FP-85. 


**THe Tungsten Halogen 
_MH = Metal Halide 


*** HPS = High Pressure Sodium 
~ Cl.Hg = Clear Mercury 
-‘Ctd.Hg = Phosphor Coated Mercury 
~ Ctd.MH = Phosphor Coated Metal Halide 
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MHI THI MH/ 
ClHg Ctd.Hg Cti.Hg  Ctd.MH 








Two general features of the data may be noted. 
First, consider the three general types of lighting 
used. As would be expected, simulated daylight re- 
sulted in more accurate color naming than did ei- 
ther the headlights only or the fixed lighting with 
headlights conditions. Second, consider the rela- 
tive accuracy of recognition for the three colors 
studied. The red samples were the best recognized 
of the three colors. (Under daylight, 100 percent of 
the subjects’ responses for the reds were correct.) 
In most cases, the orange samples were also cor- 
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Figure 9.—Mean correct color identification under fixed lighting 
with headlights. 


rectly identified by a large majority of the subjects. 
The yellow samples were, on the whole, correctly 
identified less frequently than the reds or oranges, 
regardless of the lighting condition. 


The study’s most important finding was that while 
there was variation within the material-lighting 
combinations, the type of specification (FHWA or 
ANSI) did not result in any large or systematic 
difference in the level of accurate color identifica- 
tion. This finding held true regardless of the light- 
ing condition considered. 


The second major finding was that the accuracy of 
color identification was not systematically affected 
by the type of headlamp used. This finding can be 
seen by comparing the mean percentages (aver- 
aged across all 12 materials) for tungsten-halogen 
(63.8 percent) and metal-halide (63.8 percent), as 
well as by comparing the individual percentages for 
each material under these two lighting conditions. 





Discussion and Conclusions 


This study aimed to assess the possible improvement 
in driver recognition of traffic sign colors to be 
achieved by changing from the FHWA highway col- 
ors to the ANSI safety colors. To this end, sign color 
appearance under daylight and various nighttime 
viewing conditions was investigated. Although 
some lighting-color combinations improved correct 
color recognition when viewing the ANSI safety col- 
ors, these improvements were marginal and applied 
only to some of the signing material colors and types. 


Several caveats must be recognized in discussing 
study findings. For example, one uncertainty exists 
regarding spectral correctness of the ANSI experi- 
mental samples, since these were hand-made in a 
laboratory shop. There are no color specifications for 
retroreflective ANSI safety colors at this time: the 
ANSI Z-53.1 standards to which the samples were 
made apply to opaque (nonretroreflective) paints. 


Another uncertain variable was the metal-halide lamp 
used in the experiment. The Society of Automotive 
Engineers’ Discharge Forward Lighting task force 
and CIE’s Technical Committee “Headlighting with 
HID Lamps” are still working to develop a standard 
for HID headlamps that includes, among many other 
parameters, color specifications for the metal-halide 
automotive headlamp. This study used a commer- 
cially available small wattage metal-halide lamp simi- 
lar in makeup to what the final headlamp design is 
expected to be. Although study findings thus most 
likely resemble what would be found using the final 
headlamp design, some caution should be exercised 
in using the results of this limited study to recom- 
mend color specification changes. 


Finaily, the appropriateness of the various lighting 
configurations used during data collection must be 
addressed. Red, yellow, and orange signs are pre- 
dominantly seen under either daylight or headlamp 
illumination only: with the exception of some con- 
struction signs, signs of these colors are seldom 
seen under fixed sign lighting. Thus, correct identi- 
fication of the red, yellow, and orange FHWA colors 
versus the ANSI colors is most significant under 
daylight or headlight only conditions. While the 
present nighttime study did not show any substan- 
tial benefits of the ANSI safety colors over the cur- 
rently used FHWA highway colors, other studies 
did show significant benefits when using the ANSI 
colors under diffuse daylight conditions. 
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Therefore, additional work should be conducted 
once a prototype of the finalized metal-halide 
headlamp design and appropriate retroreflective 
ANSI signing material samples are available. This 
work should investigate not only the color recogni- 
tion of these materials, but also their overall effec- 
tiveness relative to road safety. 
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How to Conduct Questionnaire Surveys 


by Peter A. Kopac 























ih Governments are 
very keen on amassing sta- 
tistics—they collect them, 
add them, raise them to the 
nth power, take the cube 
root, and prepare wonder- 
ful diagrams. But what you 
must never forget is that 
every one of those figures 
comes... from the village 
watchman, who just puts 
down what he damn 
pleases. (1)' 





—British economist 
Josiah Stamp, 1929 


‘Italic numbers in parentheses identify 
references on page 15. 


Introduction 


Designing, organizing, and con- 
ducting a questionnaire survey 
is like establishing and running a 
business. Although these activi- 
ties require technical knowledge 
and skill, administrative ability, 
and specific experience or train- 
ing, the general impression is 
that, with a little luck, anyone 
can do them well. Thus, many 
people assume that starting a 
business requires no special 
skills beyond a willingness to 
try. The annual failure of thou- 
sands of new small businesses 
demonstrates the naivety of this 
assumption. Similarly, the find- 
ings from thousands of ques- 
tionnaire surveys that are unreli- 
able or misleading prove that 





conducting a viable, reliable 
questionnaire survey is not as 
easy as it might seem. 


Contrary to common assump- 
tions, a questionnaire is more 
than a list of questions. Rather, it 
is a scientific instrument for 
measuring and collecting par- 
ticular kinds of data. And, like all 
other scientific instruments, a 
questionnaire must be designed 
in accordance with particular 
specifications and tailored to the 
specific aims of the surveyor. (2) 
Only by careful “soup-to-nuts” 
planning, construction, and 
implementation can reliance be 
placed upon the results of the 
questionnaire survey. 
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To assist anyone planning to 


conduct a questionnaire survey, Planning the Survey 

this article provides a compre- 

hensive checklist of items to 1. What question or questions are to be answered by the survey? 
consider in questionnaire devel- 


opment (figure 1). These items . How and by whom will the results be used? 
take the surveyor from the initial 
survey planning stages through 
instrument design and develop- 
ment and on to actual survey 


3. How large an effort is needed? 


. Is the desired information already available? 


implementation. By following 5. How will information be obtained? 
the information and suggestions 

provided here, surveyors can . What kind of sampling is appropriate? 
use a systematic methodology a 


to collect valid data and achieve 7. How big a sample is needed? 
i PEE eT DS I SS SE IEE RR A EE 
reliable results. Constructing the Questionnaire 


Planning the Survey 1. Is there a clear understanding of the topic to be addressed? 


What question or questions are . Are needed definitions provided’? 


to be answered by the survey? 


. How long should the questionnaire be? 


Before the survey can be under- 


. Are the right type(s) of questions being asked? 
taken, the surveyor must be able 


to present its objective clearly 5. Are questions properly worded? 
and specifically. What is the 

problem that the survey will ad- . Are questions in logical order? 
dress? Typically, the general na- 


ture of this problem has been . Is the questionnaire attractive? 
determined already. However, 


: Sending the Questionnaire 
the surveyor must further define 


the specific problem that is to be 1. Has the questionnaire been pretested? 
studied objectively and scientifi- a 

cally in the survey. . Is the cover letter effective? 

Next, the surveyor must deter- 2 3. When should the questionnaire be sent? 
mine the facts needed to answer 

the problem statement. What 4. When and how to followup? 


are the specific questions to be 
answered by the survey? What 
data need to be collected? Col- Figure 1.—Questionnaire development checklist. 
lecting information for its own 

sake rarely justifies the effort re- 

quired to assemble and present 





it. Therefore, the survey should How and by whom will the How large an effort is needed? 
not pose questions whose an- results be used? 

swers are interesting but unes- Depending on the nature of the 
sential to the main thrust of the This question is related to the problem to be addressed and the 
investigation. In making these previous one. In developing the amount of information already 
determinations, the surveyor survey plan, the surveyor must available on that topic, the sur- 
should keep in mind the keep in mind the characteristics veyor may want to use the survey 
survey's end user—the agency and information needs of the as asmall preliminary or pilot 

or individuals who will use the survey's eventual consumers. study to form the basis for recom- 
survey findings. By keeping While it is not possible to fore- mended subsequent research. 
these potential consumers in see all the misuses to which sur- 

mind, the surveyor is more vey statistics may be put, many This option, however, is rarely 
likely to determine those ques- abuses can be prevented if the available: more often the prob- 
tions that will be most meaning- surveyor is aware of the con- lem needs to be addressed in 

ful and useful. sumers’ needs. full immediately. In these cases, 
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the surveyor should have some 
control or input relative to plan- 
ning the survey’s required fund- 
ing and time. The surveyor 
should ensure that sufficient 
funds will be available not only 
for the collection of the neces- 
sary data but for their tabulation, 
analysis, and presentation. Simi- 
larly, the surveyor should ensure 
that sufficient time is allotted for 
questionnaire development, dis- 
tribution, collection, followup, 
and for resolving any problems 
that may arise. If either the sur- 
vey budget or schedule is under- 
estimated, the survey is not 
likely to be successful. 


Is the desired information 
already available? 


No survey should be undertaken 
until the surveyor is satisfied 
that the required facts have not 
already been collected. Often, a 
careful search will show that 
some of the desired information 
is already published or on file. 
However, if the available facts 
are inconclusive, outdated, or 


Survey Procedure | 


Personal interview 


otherwise insufficient, the sur- 
veyor can profit by avoiding the 
mistakes of the earlier survey or 
by expanding upon those as- 
pects that the original did not 
emphasize. (3) 


How will information be 
obtained? 


Once the problem to be investi- 
gated has been defined and the 
decision to conduct a survey fi- 
nalized, the surveyor should 
next decide what survey method 
should be used to obtain the de- 
sired information from the re- 
spondents. Three general survey 
procedures are available: 


* Personal (face-to-face) interview. 
* Telephone interview. 


* Self-administered question- 
naires. 


The advantages and disadvan- 


tages of these procedures are 
shown in figure 2. 


Advantages 


¢ Yields high percentage of returns. 

¢ Information secured is more likely to be correct 
than with other methods. 

¢ Interviewer can control who answers questions. 

« Language can be adapted to suit respondent. 

¢ More of respondent's time can be taken than with 
telephone interviews. 

¢ Visual material can be presented to respondent. 

* Face-to-face interview more conducive to 
considered responses. 

Telephone interview * Quickest of the survey techniques. 

* Low cost. 

* Low refusal rate. 

Self-administered questionnaire ¢ Low cost. 

(usually delivered by mail) « Anonymity can be ensured. 

« Can be answered at the respondent's convenience 
giving respondent time to consider each point. 


Figure 2.—Advantages and disadvantages of three popular survey procedures. (3) 





What kind of sampling is appro- 
priate? 


Although it is sometimes possible 
to survey an entire population, 
generally this technique would re- 
sult in an unwieldy amount of 
data. To limit the population sur- 
veyed, a sample is drawn to re- 
flect the characteristics of the total 
population. By using a carefully 
drawn sample, the surveyor is as- 
sured that potential respondents 
have been selected in a standard, 
scientific manner. 


Many surveyors assume that a 
sample can be drawn unsys- 
tematically—e.g., by accident or 
self-selection—and thereby yield 
a random sample. This assump- 
tion is incorrect: unsystematic 
sampling may be biased at worst 
or unrepresentative at best. Be- 
cause many surveyors fail to de- 
cide what population they are 
sampling, they have no way of 
knowing if they are exposing all 
of the population to the sampling 
process. A similar problem exists 


¢ High costs. 

¢ Interviewer bias may distort returns. 

* Recorded data may be inaccurate if 
interviewer 1s not properly trained. 

¢ Takes more time than telephone interview. 


¢ Attitude scales must be used with caution. 
¢ Visuals cannot be used. 


* Low returns. 

* Questions can be misinterpreted. 

* Questions must be simple and 
self-explanatory. 

* Questionnaire must be brief. 

¢ Answers are likely to be brief ad superficial. 
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when the source or list from 
which the sample is chosen does 
not represent the population. 
Therefore, the surveyor must first 
define the survey population and 
then select a method or methods 
of sampling it. Following are de- 
scriptions of the most commonly 
used sampling types: 


* Random sampling. 
* Stratified sampling. 
* Purposive sampling. 


By using two or more of these 
sampling techniques, a survey 
can capitalize on their combined 
advantages and counterbalance 
their disadvantages. This 
method is called double or 
mixed sampling. 


Random Sampling. Random 
sampling assures each indi- 
vidual or element in the popula- 
tion the same chance of being 
chosen for inclusion in the sur- 
vey. If the sample is chosen at 
random and is sufficiently large, 
it will represent all the groups in 
the population in approximately 
the correct proportions. One ad- 
vantage of random sampling is 
no advance knowledge of the 
characteristics of the population 
is necessary. A disadvantage of 
the technique is that a low per- 
centage of returns could result 
in an accidental sample. (3) 


Stratified Sampling. Stratified 
sampling is frequently recom- 
mended as the most efficient 
procedure for ensuring repre- 
sentativeness. (3) The procedure 
calls for dividing the population 
into two or more strata and then 
drawing a random sample from 
each stratum. Stratified sam- 
pling may be proportional or 
disproportional depending on 
the number of samples selected 
within each stratum. In propor- 
tional stratified sampling, 
samples are drawn from each 
stratum in the same proportion 
as they occur in the population. 
Consequently, the only differ- 
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ence between proportional 
sampling and random sampling 
is that the former ensures that 
the right proportion is obtained 
from each stratum. (3) In dispro- 
portional stratified sampling, 
an equal number of samples is 
secured from each stratum, 
thereby facilitating reliable 
comparison of the different 
strata. The goal of obtaining an 
equal number of samples, how- 
ever, is very difficult to achieve 
in actual practice. 


Purposive Sampling. The objec- 
tive of purposive sampling is to 
make the sample look like the 
population. There are several 
ways of doing this: 


« Select the sample so its aver- 
ages are the same as the popu- 
lation averages for known char- 
acteristics believed relevant 
to the phenomenon being 
investigated. 


* Select the sample so its fre- 
quency distribution of each rel- 
evant characteristic resembles 
the population’s frequency dis- 
tribution. 


* Select the sample so it will con- 
tain the same proportions as 
the population’s at the upper 
and lower ends of the fre- 
quency distribution (deciles, 
quartiles, etc.). 


* Select the sample so that its 
variability (e.g., standard devia- 
tion) is the same as the popula- 
tion variability. 


One advantage of purposive sam- 
pling is it may be cheaper than 
other sampling techniques. A ma- 
jor disadvantage is that much 
must be known about the popula- 
tion before sample selection. 


How big a sample is needed? 


The optimum sample size en- 
sures efficiency, representative- 
ness, and reliability. It should pro- 
vide the most useful information 
with the required level of reliabil- 


ity at the minimum cost. The 
sample should be large enough 
to yield statistically representative 
and significant results in all key 
proposed tabulations and to 
avoid intolerable sample error. It 
should not be so large, however, 
as to waste funds, delay the 
project, or achieve a needlessly 
high level of precision. 


When trying to determine the 
optimum size of the sample, the 
surveyor should follow the guid- 
ance provided below. In general, 
the surveyor should note that it 
is sound practice to err on the 
side of too large a sample rather 
than too small. (3) 


To determine optimum sample 
size, the surveyor should per- 
form the following. 


Secure preliminary information 
about the population. lf the 
sample will be used to make a 
percentage estimate of the popu- 
lation, a preliminary estimate of 
the approximate size of this per- 
centage is needed. On the other 
hand, if the purpose is to predict 
the average of the population, the 
surveyor needs an estimate of the 
standard deviation. Fortunately, 
both these estimates can be 
rough and still prove useful. 


Determine the required preci- 
sion of the prediction. This de- 
termination depends upon the 
error permissible in the estimate 
and the degree of confidence 
that the estimate will fall within 


_ the permissible error. 


Calculate the required sample 
size. For estimating percentages, 
use 
pqz 
Te 


where 
p = the preliminary estimate 
of the percentage 
q=100-p 
z = the number of standard 
error units (from a normal 
probability table) 
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T = the required precision or 
tolerance 


Example: Suppose we are per- 
mitted a +5-percent error in esti- 
mating from a population the 
percentage of engineers with 10 
years or more of experience. As- 
sume we will be satisfied with a 
90-percent degree of confidence 
that the estimate will fall within 
the 5-percent tolerance. We have 
reason to believe that the per- 
centage of engineers with 10 
years or more of experience is 
somewhere around 75 percent. 
Substituting in the formula 
above, we have: 


n = (75)(25)(1.64)? /(5)? 
np=202 


(75)(25)( 1.64)? 
n= arabe ene 


Thus, we need to take a random 
sample large enough to assure 
responses from about 200 engi- 
neers if we want a 90-percent 
probability that the true percent- 
age is within +5-percent. 


For estimating averages, use 





=_ OZ 2 
n= ( r ) 
where 
o = the estimated standard 
deviation 
z = the number of standard 
error units 
T = the required precision or 
tolerance 


Example: Suppose we want to es- 
timate the average design 
strength of concrete pavement 
mixes within 100 lb per square in 
(psi) (7.0 kg/cm’). Let us assume 
we will be satisfied with a 95-per- 
cent degree of confidence that 
Our estimate will fall within the 
100-psi (7.0 kg/cm?) tolerance. 


If we use 300 psi (21.1 kg/cm?) as 
the estimated standard deviation 
of concrete pavement mix de- 
sign strength, we can substitute 
in the formula above: 
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n -| (3000)(1.96) ] 
% 100 


ni=35 


Thus, we need to take a random 
sample large enough to assure 
35 responses regarding concrete 
pavement mix design strength 

if we want a 95-percent probabil- 
ity of estimating the average 
design strength within +100 psi 
(7.0 kg/cm’). 


If the preliminary estimate of 
either the percentage or stan- 
dard deviation proves to have 
been too large, the computed 
sample size also will have been 
larger than necessary and there- 
fore conservative; the prelimi- 
nary estimate may also come 
out too small, with the opposite 
result. To help set sample size, 
the surveyor should try various 
estimates in the formula to see 
what effect each has on the 
computed sample size. 


Construction of the 
Questionnaire 





Is there a clear understanding of 
the topic to be addressed? 


If the questionnaire is to be 
meaningful to others, the sur- 
veyor needs to have a good 
working knowledge of the topic 
to be addressed. If the surveyor 
does not fully understand the 
topic, the questions may be 
vague or ambiguous, complex 
issues may be oversimplified, in- 
sufficient space may be pro- 
vided for responses, etc. In such 
cases, respondents may show 
their frustration by either rush- 
ing through the questionnaire, 
providing only superficial an- 
swers or not responding at all. 


Are needed definitions pro- 
vided? 


Related to understanding the 
survey topic is the concept of 
understanding the respondents. 
The surveyor must: 


* Understand the respondents’ 
language, and use it correctly. 


¢ Not talk down to the respon- 
dents. 


* Not assume too quickly that re- 
spondents will understand the 
question in the intended frame 
of reference. 


¢ Ensure that the questions have 
the same meaning for all re- 
spondents. (4) 


Additionally, definitions of key 
terms used in the questionnaire 
should be provided. There 
should not be too many defini- 
tions, nor should the definitions 
be lengthy or complicated. The 
definitions may appear together 
in a section above the questions 
themselves; if only one or two 
definitions are to be given, it 
may be more appropriate to 
include them in notes following 
the respective question. The 
objective is to get the respon- 
dents to read and understand 
each definition. 


How long should the question- 
naire be? 


The percentage of question- 
naires returned decreases as the 
number of pages increases from 
1 to 10. (Interestingly, there does 
not seem to be a significant dif- 
ference in the percentage of re- 
turns as pages increase from 10 
to 35.) Although evidence sug- 
gests that with the proper incen- 
tives and a carefully pretested 
form, certain groups will re- 
spond thoroughly to a very long 
questionnaire. However, the 
best approach is to keep the 
form as short as possible to ob- 
tain the needed information. (3) 


To keep the questionnaire’s 
length down, the surveyor 
should evaluate each proposed 
question separately. Only those 
questions bearing directly on the 
problem should be included; an- 
swers to questions that can be 
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secured from other sources may 
be deleted unless absolutely 
necessary as a check. 


Are the right type(s) of ques- 
tions being asked? 


There is no generally accepted 
type of question that can be uni- 
versally recommended for all 
questionnaires. Rather the 
type(s) of questions selected for 
use in a given questionnaire 
should depend primarily on the 
anticipated tabulation plan (i.e., 
how will the data be grouped in 
the tables?). To determine the 
appropriate type(s) of questions 
to use, the surveyor should both 
consider the tabulation plan and 
the strengths and limitations of 
the various types of questions 
as presented below. 


Open-End Questions. Open-end 
questions give respondents free 
latitude in making their re- 
sponses. An example of such a 
question is “What is the principal 
reason for your dislike of product 
A?” A drawback to their use is 
that open-end questions may 
yield such a variety of responses 
that the task of condensing and 
analyzing them is both time con- 
suming and difficult to handle sta- 
tistically. Open-end questions are 
often used in the exploratory 
phases of a study when the area 
covered by the question is still 
not well understood. 


Dichotomous Questions. These 
questions elicit either/or re- 
sponses (yes/no, true/false, 
good/bad, etc.) They usually also 
allow for a third response such 
as “don’t know,” “neither,” etc. 
Surveyors, however have found 
that if the noncommittal third al- 
ternative is not given, relatively 
few respondents will fail to 
make a choice between the two 
options presented, thereby 
“forcing” some respondents to 
take a definite stand when actu- 
ally they would not do so other- 
wise. The chief advantage of the 
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dichotomous question is its sim- 
plicity. One of its limitations is 
that a slight misunderstanding 
of the question’s meaning may 
result in a complete reversal of 
response. (3) 


Multiple Choice Questions. Mul- 
tiple choice questions allow 
respondents to choose from 
among several possible answers. 
The list of alternatives must be 
complete enough to cover all 
possible answers. Multiple choice 
question results can be tabulated 
easily and interpreted with 
greater precision than can an- 
swers to open-end questions. 
Multiple choice questions may 
take any of several forms; argu- 
ably the most popular of these 
are checklists and rating scales. 


Checklists. Checklists are mul- 
tiple choice questions consisting 
of a statement of the problem or 
question followed by a list of 
three or more possible answers. 
Checklists should be made up 
only after some preliminary sur- 
vey or pretest has determined 
the types of replies that may be 
expected; this ensures that most 
answers will not fall in the 
“other” category that is usually 
provided with a limited list. The 
advantage of the checklist is that 
it serves to remind respondents 
of their various options. 


Rating Scales. Rating scales allow 
respondents to choose among 
various degrees of opinion. The 
scale may be numerical (e.g., 
ranging from 1 to 5) or verbal 
(e.g., ranging from “poor” to “ex- 
cellent”). Most dichotomous 
questions can be turned into rat- 
ing scale questions simply by in- 
troducing degrees of opinion to 
the response options. After doing 
so, the extreme responses can be 
sorted out for use in comparative 
analyses where a high statistical 


significance level is desired. One ~ 


problem with rating scale ques- 
tions, however, is there is often a 
tendency for the respondent to 
choose a moderate rating. 


Ranking of Items. In ranking of 
items questions, the respondent 
is asked to arrange a list of 
words, phrases, statements, pic- 
tures, etc., in some order. The 
ranking adds a dimension not 
found in checklists. However, a 
limitation of these questions is 
the fact that the size of the inter- 
vals between rankings is usually 
not the same: the difference be- 
tween the first and second 
choices may be much greater 
than the difference between the 
second and third choices. An- 
other limitation is the relatively 
small number of items that may 
be included. It has been sug- 
gested that as few as three 
choices give the best results; the 
optimum number probably var- 
ies with the subject matter. (3) 


Are questions properly worded? 


Asking questions to gain desired 
responses is more difficult than 
it may seem. The greatest dan- 
ger in wording questions lies in 
taking too much for granted re- 
garding language and terminol- 
ogy, reader comprehension and 
background, etc. Surveyors 
must develop a critical attitude 
toward their questions and 
should carefully analyze the 
wording of each. The critique is 
best done during pretest of the 
questionnaire. Every objection 
that may be raised about the 
phrasing should be carefully 
studied and answered. (4) 


Following are some suggestions 
for wording questions: 


¢« Use simple words and correct 
punctuation 


¢ Use underline or boldface type 
for emphasis. 


* Make questions concise and 
unambiguous. 


* Formulate questions to yield 
exactly the information desired 
(e.g., specify the units for the 
answer) and avoid leading 


questions, i.e., questions 
worded in such a way as to 
suggest the answers. 


Avoid words such as “always” 
or “any,” “about” or “near,” 
“possible,” and “should.” When 
using “you” or “your,” make it 
clear whether the second person 
singular or plural is intended. 


Cover only one point per ques- 
tion. If there are two or more 
ideas in the question, it will be 
confusing to determine to which 
thought the answer applies. 


Allow for all possible re- 
sponses, i.e., multiple choice 
answers should be mutually 
exclusive and complementary 
and provide for “don’t know” 
and “other” answers. 


* Keep asking “What am | as- 
suming or taking for granted by 
this question?” 


Are questions in logical order? 


To avoid confusion and misun- 
derstanding, questions should 
be arranged logically. The ques- 
tionnaire should, for example, 
open with a question that can be 
easily answered, preferably with 
a simple yes or no. If a difficult 
question is asked at the begin- 
ning, respondents may refuse to 
continue with the questionnaire. 


After this important opening 
question, there must be an easy- 
to-follow logic, an established 
order, to the form. Order should 
be considered at three presenta- 
tion levels: 


* Topics covered by the ques- 
tionnaire. 


* Questions under each topic. 


* Response alternatives to a 
single question. (5) 


The surveyor should note that 


once a train of thought has been 
established, breaking that se- 
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quence can lead to poor results. 
Thus, a totally unrelated question, 
suddenly asked, is not desirable. 


Is the questionnaire attractive? 


An attractive questionnaire is a 
strong selling point for respon- 
dent cooperation. Attractiveness 
can be accomplished by the ap- 
propriate use of colors, pictorial 
materials, spacing, type, arrange- 
ment, etc. Research has shown 
that yellow paper—followed 
closely by pink—has the highest 
percentage of returns; dark-col- 
ored questionnaires usually are 
not effective. (3) The question- 
naire should look easy to com- 
plete. This goal can be met by 
requiring very little writing of the 
respondent and/or arranging the 
various items so the question- 
naire does not appear crowded. 


Sending the Questionnaire 


Has the questionnaire been 
pretested? 


Regardless of how carefully the 
questionnaire has been worded, it 
should not be assumed that it will 
work well until it has been tested 
under field conditions. A pretest 
can be used to check the wording 
and sequence of questions, ques- 
tionnaire length, clarity of instruc- 
tions, effectiveness of cover letter, 
and other related items. Pretests 
also enable the surveyor to turn 
open-ended questions into mul- 
tiple choice ones. 


A pretest is normally done by 
furnishing the questionnaire to 
typical respondents, reviewing 
their responses, and interview- 
ing them to get their reactions, 
suggestions, and other com- 
ments. Based on this feedback, 
the questionnaire is then revised 
as appropriate. Especially diffi- 
cult questionnaires may require 
several revisions. 


Another way to pretest the ques- 
tionnaire is by developing sev- 
eral different drafts and simulta- 


neously sending a different draft 
to each of several small samples 
of respondents. Such a pretest 
will provide comparative infor- 
mation on relative rates of re- 
turn, data completeness and ap- 
propriateness, data suitability 
for tabulation, etc. (3) 


Is the cover letter effective? 


A letter of transmittal soliciting 
respondent cooperation should 
accompany the questionnaire. 
This letter should: 


* Be on official letterhead. 


* Explain the purpose of the 
survey and the uses to be 
made of the data. 


* Provide instructions on how to 
fill out the form (if such instruc- 
tions are not printed on it). 


* Thank the respondent for 
cooperating. 


Customized, personal touches to 
the letter can be effective in moti- 
vating potential respondents. 
Examples include a hand-written 
postscript or personal signature. 
(3) Another possible “motivator” 
is including self-addressed 
stamped or franked envelopes. 
Finally, promising to furnish 
survey results to respondents 
can also be effective. Of course, 
such a promise must be fulfilled 
in a timely manner. 


When should the questionnaire 
be sent? 


The surveyor must determine 
the most opportune time for 
sending out the questionnaire. 
This choice may be based on 
several factors, since the season 
of the year, the month, week, or 
time of the week during which a 
questionnaire should arrive in 
order to have the best chance of 
being filled out will vary with the 
type of respondent. (For ex- 
ample, a survey of construction 
engineers might best be done in 
the winter months when work is 
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not at its peak.) The surveyor 
should also take into account the 
timing of the mailing vis-a-vis 
periods such as holidays, ex- 
tremely hot weather, and impor- 
tant national events. 


When and how to followup? 


Followup of some kind is usually 
required to ensure an adequate 
rate of response. (3) The first 
followup might take the form of 
a short note or postcard remind- 
ing the recipient of the overdue 
questionnaire. A tactful sugges- 
tion may be included to disre- 
gard the reminder if the reply is 
on the way. The second re- 
minder may include a copy of 
the questionnaire since the re- 
spondent may have misplaced 
the original. This second 
followup may also take the 

form of a telephone call. 


The first followup activity should 
be undertaken when the daily re- 
turns have dwindled down to a 
trickle. Subsequent followups, if 
needed, should be spaced closer 
and closer together. 


The acceptable percentage of re- 
sponses depends on such vari- 
ables as type of respondent, size 
of the questionnaire, subject 
matter, etc. However, it is not 
unrealistic to expect a 75-per- 
cent or greater rate of response 
for most questionnaires. (6) 


Summary 


This article is intended to pro- 
vide guidance for the develop- 
ment of generic questionnaires. 
While the examples provided 
are engineering- or highway- 
related, the discussion may 

be equally applicable to ques- 
tionnaires in other fields. 
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There is more to developing 
good questionnaires than just 
wording good questions. Weeks 
of planning and exploratory 
work are often needed. Thus, it 
is important that the surveyor 
schedule sufficient time. Suc- 
cessful questionnaire develop- 
ment includes identifying the 
specific problem, understanding 
the subject matter, and knowing 
the respondents. Appropriate 
survey method, sample size, 
type of sampling, and type of 
questions have to be given ad- 
equate consideration. The use of 
pretest is probably the greatest 
help in devising the actual word- 
ing of questions. The surveyor 
should also think well ahead to 
the data analysis phase. Because 
each survey tends to present its 
own problems, no amount of ad- 
vice or guidance can substitute 
for thoughtful care, common 
sense, and good organization. 
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Introduction 


During the past year, the Federal Highway Adminis- 
tration (FHWA) has greatly increased emphasis on 
the marketing of new technologies. As part of the 
October 1990 FHWA reorganization, a new office of 
Technology Applications was formed to increase 
the agency’s effectiveness in implementing and de- 
ploying new and improved products. Prior to the 
formation of this new office, the requirement for 
marketing new technology and research and devel- 
opment (R&D) products to the highway community 
were developed and arrayed into a multi-phased 
process. (7)' To further delineate marketing prin- 
ciples appropriate for inclusion in public sector op- 
erating programs and to help translate these prin- 
ciples into specific technology transfer efforts, a 
seminar is now being developed for both the FHWA 
and other transportation agency personnel. 


Technology Transfer 
Technology transfer is the process by which the re- 
sults of R&D are converted into practical and useful 


processes, products, and programs. Earlier Public 
Roads articles have dealt with various issues re- 


‘Italic numbers in parentheses identify references on page 21. 
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lated to technology transfer and R&D product mar- 
keting. (2,3,4) This article looks at the fundamental 
ingredients of marketing strategies and new meth- 
ods of technology transfer to rapidly deploy imple- 
mented technology. 


To be useful, the products of highway-related R&D 
must be carefully marketed to potential users. This 
selling process applies both to a technology which 
the “customer” acknowledges is needed (e.g., a high- 
way sign format that allows improved message rec- 
ognition and comprehension by drivers) or one which 
solves a problem of which the customer was previ- 
ously unaware. In either case, the user must be con- 
vincingly “sold” on the product—particularly if it rep- 
resents a substitution for existing procedures. 


In such situations, the R&D product or process un- 
der development must be assessed for its ultimate 
transfer to users. A technology transfer specialist 
must thoroughly assess the R&D effort to devise a 
marketing strategy to get the R&D results to the ap- 
propriate users. This marketing strategy assess- 
ment follows the basic framework outlined below 
and displayed in figure 1. Ideally, users should be- 
come involved with—or interested in—the research 
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early in the process and be afforded opportunities 
for following its progress. This goal is easily real- 
ized when the R&D is short term and yields waited- 
for results, but it is seldom realized when the R&D 
is more fundamental and provides results only after 
many years or even decades. 


A product must be valuable. The first essential ele- 
ment in any marketing strategy is to have an actual 
or potential product that is unique and cost benefi- 
cial to users. Researchers who are conducting fun- 
damental or methodological studies do not—by 
definition—focus on the ultimate value of their 
work to end users. Rather, their work must be inde- 
pendently assessed to determine whether it may re- 
sult in a product likely to be of value to end users. 


Users must be targeted. Users must be specified 
with considerable precision. It is not enough to say 
that a particular product is for highway engineers, 
city traffic engineers, or State transportation chief 
executive officers. The salient characteristics of the 
user target group must be specified so that product 
format and instructional language are appropriate 
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Figure 1.—Essential steps in developing a highway transporta- 
tion marketing plan. 
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for that set of users. Costs and other issues should 
be presented in a framework that is relevant to and 
easily understood by that audience. 


A product must be tested. No product originating in 
R&D should be actively promoted before field testing. 
Consequently, a third essential element of a market- 
ing strategy is the systematic testing and evaluation 
of the product under operational or real-world condi- 
tions. A product developed in an R&D environment 
may work very reliably in such a setting. However, 
because researchers want their products to succeed, 
they may overlook simple and obvious problems that 
may occur when customers begin to use the new 
product. An example of such a flawed product was a 
traffic data base manager known as the Integrated 
Traffic Data System; although very impressive when 
demonstrated, it has yet to succeed in an actual oper- 
ating environment. (5) 


Appropriate technology transfer techniques must 
be used. The fourth element in a highway product 
marketing strategy is the selection of appropriate 
techniques for product delivery. Traditionally, the 
delivery of new highway products derived from 
R&D has been through written reports that gener- 
ally aim to provide the detail and background 
needed to carry out specific implementations. 
Many other delivery techniques are available and 
they generally are preferable to text formats. 


The appropriate marketing techniques to be used 
ultimately depends upon the potential user’s prior 
information and selection of appropriate ways of 
demonstrating the product’s use and benefits. The 
most common way to determine this information 
need is by conducting a limited marketing survey 
(i.e., getting systematic feedback from a sample of 
potential product users). Unless the product helps 
fulfill a brand new objective or function, the most 
effective technology transfer techniques are ones 
which permit the user to actually use a new product 
and allow the customer to visualize contrasts be- 
tween the techniques currently being used and the 
new product. “Hands-on” demonstrations ideally 
are included in any new technology transfer tech- 
nique, whether it is primarily educational, informa- 
tional, or promotional. In other words, if a customer 
is convinced that he or she can master a new tech- 
nique, the first step toward operational or day-to- 
day use is achieved and resistance-to-change 

is reduced. This critical hands-on element should 
be borne in mind as various innovative technology 
transfer techniques are examined in the next 
section of this article. 


There must be followup with users. The final ele- 
ment in a marketing strategy is to followup with 
and get feedback from users. This step is fre- 
quently treated as nonessential and separate from 
the task of getting new technology into use. How- 
ever, some technology transfer efforts succeed and 
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others fail; a great deal of information can be ob- 
tained by understanding the causes of such success 
and failure. This information can only be derived 
through followup with users. 


Technology Transfer Techniques 


Over the years, the FHWA has been most success- 
ful in providing technology transfer through direct 
technical assistance and its demonstration projects. 
The salient characteristics of such efforts are: 


¢ Personal and direct contact which provides a 
highly motivated interaction between the technol- 
ogy transfer agent and the customer. 


¢ A guided tutorial with hands-on experience and 
feedback that offers the most effective form of 
learning new procedures. 


The principal reasons that such techniques are not 
used more are simply there is insufficient time and 
money available to do the job. Techniques which 
augment or substitute for person-oriented technol- 
ogy transfer must create and maintain a “user- 
friendly” environment. 


Recent technological advances have brought about 
sweeping changes in the ways in which technology 
transfer activities can be conducted. The remainder of 
this article details the newest and most useful tech- 
nology transfer methods for application in marketing 
the products of highway-related R&D. For simplicity, 
these products and techniques are grouped by rel- 
evant area of technology transfer activity, i.e.: 


* Training. 
* Information dissemination. 


* Promotion. 


Training 





The FHWA presents highway-related training mostly 
through short courses funded by the National High- 
way Institute (NHI). The NHI mechanism represents a 
significant training tool: during fiscal year 1990, the 
NHI offered 73 different courses and made presenta- 
tions to more than 15,300 participants. 


The drawbacks of such training are that students 
must schedule their time far in advance and travel 
to specific locations. In recognition of these draw- 
backs, the NHI has recently tried to develop and 
present more “train-the-trainer” type courses. 
While such courses yield an expanded network of 
instructors thereby increasing training opportuni- 
ties, this approach does not address participants’ 
scheduling problems. Other, relatively new, training 
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technologies do, however. The use of satellite, tele- 
conferencing technology, and interactive videodiscs 
alleviates many logistic difficulties and facilitates 
training of more persons—including those support 
and paraprofessional personnel who frequently are 
not included in training allocations at all. 


Training using communications satellites is becom- 
ing commonplace for high-tech industries and orga- 
nizations such as the National Aeronautics and Space 
Administration, which routinely develops and/or uses 
this technology. There are major differences between 
standard classroom training and training using space 
satellites to reach a larger number of students over a 
broad geographic area. 


Only one U.S. organization is currently using satel- 
lites for highway training. Pennsylvania State Univer- 
sity has to date presented 3 courses on highway de- 
sign and hydraulics to 32 centers throughout Penn- 
sylvania. (6) These courses are based on training ma- 
terials already developed for classroom settings and 
augmented with video graphics and videotapes from 
construction sites. The incremental cost of satellite 
training over classroom training is approximately 
$20,000 per course. However, it is estimated that in 
Pennsylvania alone, the number of students reached 
during the same instruction periods is five to six 
times that possible via classroom training. 


Teleconferencing allows meetings to be held with- 
Out participants having to travel long distances. The 
first highway-related teleconference took place in 
1984, during the annual Transportation Research 
Board meeting in Washington, D.C. In conjunction 
with this meeting, a teleconferencing session took 
place involving 1-way video and 2-way audio trans- 
mission among 20 States. (7) Since then, two dem- 
onstrations of teleconferencing for highway engi- 
neers have taken place: one in Pennsylvania on 
hazardous wastes shipments; the other on hydrau- 
lics, Originating at the University of Tennessee. 


Interactive video provides self-paced instruction for 
individuals. It uses laser-video technology and has 
received the most study by the FHWA as an ad- 
vanced training resource. In 1982, the first FHWA 
interactive video project was undertaken to deter- 
mine the technology's feasibility for highway engi- 
neers and technicians. The FHWA began by devel- 
oping basic hardware configurations and assessing 
system cost effectiveness. (8) This effort resulted in 
the Individualized Self-Paced Instruction for Traffic 
Engineers (IN-SPITE) system. The first instructional 
material developed for this system was a course on 
traffic control in work zones, which contains mod- 
ules on the proper selection of traffic control de- 
vices, sample applications, and flagging. Based on 
testing in Arizona and Maryland, this course was 
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more effective than standard training. Last year, six 
complete IN-SPITE systems were operating on IBM- 
compatible computers; the system has since been 
distributed for further field testing. 


Microcomputer tutorials are provided on disk for- 
mats. These tutorials are usually developed for spe- 
cialized courses rather than for more general training 
purposes. Moreover, if substantial audio and com- 
plex visual materials are needed, an interactive video- 
disc system is used rather than a tutorial format. Tu- 
torials are best used to simulate the actual operations 
of an analyst using given computer software. 


The FHWA has developed one such tutorial to as- 

sist intermediate and advanced users of TRAF- 
NETSIM, a microscopic simulation model that pro- 
vides detailed evaluation of proposed operational im- 
provements on urban networks. A second course has 
been planned for the corridor flow model, CORFLO, a 
macroscopic computer simulation for corridors with 
both signalized intersections and freeways. 


Information dissemination 


Generally, technical information is disseminated to 
potential users via technology-sharing reports; dem- 
onstration projects; and oral presentations at na- 
tional, regional, and local meetings. However, the 
most effective method of acquiring information on 
new technologies is through informal discussions 
and telephone conversations. These informal means 
of dissemination tend to have greater value than the 
formal mechanisms, mainly because when an inquiry 
is made, it is usually answered immediately. These 
critical characteristics of human communication (i.e., 
active involvement and timeliness) are usually not 
present when articles are published and speeches 
presented. Also, although much written information 
is archived so that knowledge can be actively pur- 
sued through modern library systems and computer- 
based information retrieval systems, highway agen- 
cies seldom use archived information to seek out new 
technologies for performing old tasks. 


Thus, better methods for disseminating new techni- 
cal information in a manner consistent with human 
communication needs include the use of e/ectronic 
bulletin boards (EBB’s) and expert systems. Both of 
these methods obviate the need for answering 
communications in a real-time, person-to-person 
exchange, yet provide a similar convenience. 


Electronic bulletin boards provide a logical extension 
of personal networking by allowing quéstions and 
their answers to be posted using telephone lines. 
Although all established EBB’s maintain data bases 
and utility programs and post general bulletins and 
announcements, their greatest benefits come from 
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exchanges of needed information. Figure 2 
illustrates how to use EBB’s to get specific informa- 
tion. The expansion of national services such as 
PRODIGY is resulting in the broader acceptance of 
EBB’s as a routine approach for exchanging informa- 
tion. Presently, there are about 20 active EBB’s for 
highway-related information in the United States. 
These bulletin boards are operated by several of the 
Rural Technical Assistance Programs at their respec- 
tive Technology Transfer Centers and by the Institute 
of Transportation Engineers. In addition, the FHWA 
initiated its Federal Electronic Bulletin Board System 
in 1988. (9) This board supports information on spe- 
cialty conferences, such as meetings of the Traffic 
Software Users Group, and other specific information 
related to their fields of inquiry. 


EBB use is restricted by the availability of personal 
microcomputers for technical personnel and the 
number of laptop and other portable computers 
available for use in field settings. 


Expert systems are computer-based methods for 
simulating the reasoning and decision-making pro- 
cesses of human experts. They make use of domain- 
specific knowledge, allowing nonexperts to make vi- 
able decisions without extensive training or experi- 
ence in narrow specialties. An operational expert sys- 
tem is a decision tool that allows both managers and 
technicians to orchestrate facts and judgments so as 
to develop solutions to particular problems that 
mimic those that would be reached by experts. 


Federal 


Electronic 
Bulletin Board 


















































Figure 2.—The Traffic Software Users Conference. 
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Expert systems can be used to solve complex prob- 
lems for which there are no useful algorithms for 
carrying out analytical or mathematical solutions. 
Because most decisions made by highway opera- 
tional personnel are of this type, it is not surprising 
that the highway transportation field has begun to 
seriously tap the potential of expert systems tech- 
nology. To date, more than 15 highway-related ex- 
pert systems have been evaluated and refined for 
practical use by generalists. 


Expert systems now available cover a selection of 
work zone traffic control techniques, analysis of 
bridge maintenance procedures, and selection of 
mixes for rehabilitation of flexible pavements. 
(10,171,172) Many more such specialized systems 
covering a wide variety of common transportation 
engineering topics are currently under develop- 
ment or have been recently released. The FHWA 
created guidelines for developing expert systems to 
assist those interested in using this technology. (73) 


Promotion 


Private industry devotes substantial funds to promo- 
tional activities. The industry recognizes that techni- 
cians and managers must have an appreciation of the 
potential of new products being introduced into the 
marketplace. Public sector organizations such as the 
FHWA do not have large budgets for such activities, 
but can nevertheless launch effective promotional 
campaigns with the aid of several new communica- 
tion and computer-oriented technologies. 


Traditionally, technology transfer specialists have 
used educational techniques such as slide-tape 
shows, exhibits, road shows, and hands-on demon- 
strations of new technologies. Newer promotional 
tools, derived from the latest generation of micropro- 
cessors, are now coming Into common usage. These 
microprocessor-based tools permit significant reduc- 
tions in labor and time to produce useful materials in- 
cluding videotapes and demonstration disks. 


The successful promotion of new products require 
a means of motivating potential users. Such moti- 
vation can come through identification with actual 
users. Short of actual demonstrations, of hands- 
on simulations, videotape is currently the most 
readily available medium for providing a substitute 
for direct experience. 


The computer demonstration disk is a medium 
which can be used to provide the experience and 
running an actual applications program, without 
having the actual program. This technique can 
provide hands-on experience by a simple simula- 
tion of actual operations. 
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As greater usage is made of the interactive tools 
described earlier in the section on training tech- 
niques, promotional materials will be able to pro- 
vide increasing faithful simulations of the use of ac- 
tual design, evaluation, and operational tools. 


Videotapes have often been used to present and pro- 
mote complicated concepts to an array of target audi- 
ences. Recently, however, numerous developments 
in videotape scripting, production, and editing have 
increased their use and distribution. For example, the 
popularity of home video camcorders has increased 
the availability of high-quality equipment, reduced 
costs, and gone far toward eliminating the need for 
experienced production personnel. Consequently, 
good quality productions now only need a few indi- 
viduals, none of whom require extensive training. 


The price for a videotape production has remained 
relatively high, despite reductions in actual produc- 
tion costs. A number of promising developments 
should result in reduced costs, however. Recently, 
short promotional materials have been produced by 
relative novices using a technique known as video 
desktop publishing. The video desktop publishing 
technique is exemplified by a series of 5- to 10- 
minute videos depicting new and better methods for 
performing routine engineering and technician jobs. 
This video series, titled “The Idea Store” is produced 
by the Pennsylvania Department of Transportation 
and has been used effectively to motivate audiences 
unfamiliar with new products and techniques avail- 
able to the transportation community. 


The potential increased value of videotape as a pro- 
motional tool comes from the availability of afford- 
able, easy-to-use production techniques. It is a rela- 
tively simple matter today to blend and enhance 
video footage taken by novices. The inclusion of 
off-the-cuff presentations of new technologies in an 
operating environment can provide the alliance 
needed to help convince skeptics. Such involve- 
ment is not exactly hands-on, but it comes close. 


Demonstration disks provide another means of 
dramatically presenting new technologies to an 
increasing number of potential users. The general 
availability of personal microcomputers facilitates 
this method of graphically representing new 
highway products using standard-sized micro- 
computer floppy disks. 


Demonstration disks are most appropriately used to 
convey the benefits of microcomputer software; the 
technique is commonly used by the computer soft- 
ware industry. The first FHWA demonstration disk 
aimed at promoting the use of a specific software 
package has been developed for the microcom- 
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puter version of TRAF-NETSIM. The program’s 
graphics quality enhances the outputs for both 
users of the software and managers. 


Demonstration disks also can be used to promote 
products that have little or no relation to microcom- 
puters. For example, one of the FHWA’s demonstra- 
tion disks converted a general information brochure 
to a computerized format. This format depicted the 
relationships among major federally supported traffic 
software packages more dynamically than was pos- 
sible with a static brochure. In fact, the demonstra- 
tion disk appears to have increased comprehension 
of potential traffic managers and software users as to 
the capability of various software packages. 


Conclusion 


Numerous new tools that make extensive use of 
common communication and computer technolo- 
gies are available to technology transfer specialists. 
Used properly, these tools can facilitate the rate at 
which new technologies are understood by poten- 
tial users and put into use. All traditional areas of 
technology transfer—training, information dissemi- 
nation, and promotional activities—can be en- 
hanced by these new tools. However, such tech- 
nologies should not be used indiscriminately; 
rather, they should be applied in the context of an 
overall marketing strategy for transferring those 
new technologies that have been shown to work 
under real-world conditions and are cost effective. 
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STATISTICAL SHORTCOMINGS 


IN TRAFFIC STUDIES: 


P. ! of this article, which 
appeared in the last issue of 
Public Roads, discussed the 
theoretical advantages of 
factorial design—its effi- 
ciency, economy of experi- 
mental units, and ability to 
provide information on sev- 
eral treatment factors jointly 
and simultaneously— 

thus permitting a broader 
generalization of the experi- 
mental results. This article 
describes the practical ad- 
vantages and disadvantages 
of factorial design. 
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PART II 


Harry S. Lum 


Introduction 


Factorial design is a powerful tool 
that can provide information not 
otherwise obtainable from single- 
factor experiments. There are, 
however, limitations in its use: 
these are due more to practical 
than to theoretical constraints. 
One such limitation is a logistical 
one, applying to the availability 
of resources (e.g., time, labor, 
and the pool of experimental 
units). A second limitation is 
interpretive—the complexity of 
the factorial design experiment 
often makes it difficult to interpret 
and explain results. 


This article explores the nature of 
these limitations, their impacts on 
factorial design, and methods for 
alleviating these impacts. 


Logistic Limitations 


In a simple 2 by 2 factorial de- 
sign, the number of treatment 
combinations is four. As more 
factors or levels are added to the 
design, the number of treatment 
combinations expands geo- 
metrically. Doubling the num- 





ber of levels of a 2 by 2 design 
to 4 by 4 yields 16 treatment 
combinations, four times that of 
the original design. Similarly, 
an ambitious 3 by 3 by 3 by 3 ex- 
periment comprises a total of 81 
treatment combinations. The 
logistic difficulties implicit in this 
large total are illustrated by the 
following example. 


Suppose a researcher wants to 
investigate the driving behavior 
of people over 65 years of age. 
The researcher plans to use four 
replicates—a factorial experi- 
ment requires a minimum of 
two replications to estimate 
sampling variance. For a3 by 3 
by 3 by 3 experiment, four repli- 
cates will require 324 subjects. 
Even if it is possible to recruit 
this number of subjects, the re- 
searcher can expect to lose 
some before the experiment is 
over. This attrition may be due 
to illness, “no shows,” or 
“aborts” (i.e., subjects chose not 
to continue the experiment after 
starting it). The greater the 
number of subjects involved in 
the study, and the lengthier the 
study sessions, the greater the 
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chance of subject attrition. 
Moreover, even if the researcher 
can recruit and retain all re- 
quired subjects, scheduling 
problems, equipment failure, er- 
rors in recording data, or the 
loss of completed data sheets 
may also result in an unequal 
number of observations. 


Interpretation Limitations 


The second limitation of high or- 
der factorial design is the diffi- 
culty in substantive interpretation 
of the data because of the com- 
plexity of the phenomenon under 
investigation. For example, in a 
three-factor experiment, there will 
be one three-factor interaction 
term (A by B by C) and three two- 
factor interaction terms (A by B, A 
by C, and B by C). If the experi- 
ment shows that none of these 
terms are statistically significant, 
the researcher can say that the 
three factors affect the response 
variable independently of each 
other. On the other hand, if the 
three-factor interaction /s signifi- 
cant, then each of the two-factor 
interaction terms must be investi- 
gated separately at each level of 
the third factor. If the three-factor 
interaction term is not significant, 
but any or all of the two-factor 
interactions are significant, then 
each of the single factors must 


be explained or interpreted with 
reference to the specific level of 
the two factors. And as more 
factors are introduced into the 
design, data interpretation 
grows in complexity. 


For a 4-factor factorial design, 
there are 11 interactions that 
must be assessed. Some of the 
interaction terms may be statisti- 
cally nonsignificant; others, mar- 
ginally significant; still others, 
statistically significant. The re- 
searcher must evaluate the re- 
sults, in light of the statistical 
evidence, for their practical sig- 
nificance or theoretical implica- 
tion. However, the fact that sta- 
tistical analysis indicates that a 
given interaction term is signifi- 
cant does not necessarily mean 
that it has substantive meaning. 
Rather, it could be that there is 
no interaction but, due to sam- 
pling variation, a large enough 
value was obtained to be de- 
clared significant. On the other 
hand, a significant interaction, 
while real, may run contrary to 
present knowledge. Such an in- 
teraction should not be ignored 
or dismissed as spurious for one 
of the advantages of factorial 
design is to suggest other 
approaches or provide greater 
insight into a particular research 
problem. Consequently, there is 


no formulaic easy way to ana- 
lyze factorial experiments and 
interpret the results. Each ex- 
periment is unique and subject- 
matter oriented. 


The consequence of the logistic 
limitation usually results in an 
unequal number of observations 
among the cells. The impact of 
this limitation is that statistical 
analyses become complex. 

In the extreme case where the 
disparity of cell sizes is too 
great, the whole experiment 
would be useless. 


Impacts of Limitations: 
Unequal Cell Sizes 


A requirement for factorial ex- 
periments is that each cell must 
have an equal number of obser- 
vations (n’s). Statistical tests 
based on equal n’s tend to be 
less sensitive to distortions 
when certain assumptions un- 
derlying the statistical tests are 
violated. Mild departure from 
the assumptions of normality 
and homogeneity of variance 
among the cells poses no seri- 
ous problem in interpreting the 
outcome of an analysis:of vari- 
ance when the n’s are equal. 
Furthermore, calculations are 
simpler with equal n’s since the 


Table |.—Artificial data for a 2 by 2 factorial experiment with unequal cell sizes 








data =  3,4,4.2 
total mel 
mean =e 
#ofobs = 4 
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cell (1,1) cell: Ch?) 


data Shae ys) 
total 
mean 
# of obs 


data =) 445; 
total = ie! 
mean = 4.50 
#ofobs = 4 


Total of means = 6.25 Total of means = 7.50 









Total of means = 6 











Total of means = 7.75 






Grand total = 13.75 
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Component 


Row 
Column 
Interaction 


Error 


Sum of squares 


0.766 x n, = 2.828 
0.391 xn, = 1.444 
0.391 xn, = 1.444 


5.750 


C (correction factor) = (13.75)*/4 = 47.266 


Row = 1/2[6°+ 7.757] - C = 0.766 


Column = 1/2[6.257+ 7.507] - C = 0.391 


Table 2.—Analysis of variance of data from table | 


| Degree of 
freedom | 


Error = 5.750 = 192 - 186.250 





Total by definition = 11.733 = 192 -180.267 


Harmonic mean n, = (2 x 2)/[1/4 + 1/3 + 1/4 + 1/4] = 3.692 


Interaction = 37+37+3.257+4.5?-row - column - C = .391 


n’s can be treated as a constant. 
To illustrate, the variance of the 
mean of the /th row and the jth 
column is 07/n.. If n= for all 
the cells, then the variance of 
the mean for any cellis o2/n. 


In practice, even with careful 
planning and rigid control of a 
moderate-sized experiment, 
more often than not the re- 
searcher must work with un- 
equal n’s. Under certain condi- 
tions, however, there are quick 
and easy methods of analyzing 
data from an experiment with 
unequal cell frequencies. These 


methods are: 


* Unweighted means—Appili- 
cable when the disparity in the 
n's is no greater than a ratio of 
2 to 1 between the largest and 
the smallest n’s, and most of 
them are in close agreement. 


* Equal numbers within rows 
(columns). Applicable when the 
cell frequencies within any row 


(column) are equal. 


* Proportional subclass num- 
bers. Applicable when the cell 
frequencies are proportional, 
i.e., in the same proportion 
within any row or column. 
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These methods provide exact 
statistical tests in the absence of 
significant interactions. Ex- 
amples of these methods are 
available in reference 7. 


Unweighted means 


The method of unweighted 
means is used in many computer 
software packages to analyze 
data with unequal cell frequen- 
cies. Since this is a common prac- 
tice, anumerical example is pre- 
sented here to illustrate the ra- 
tionale of the method together 
with the necessary calculations 
for the analysis of variance table. 


The data in table 1 is contrived: 
the numbers are simple to facili- 
tate computations of the analy- 
sis of variance table. There are 
four data points in all the cells 
except for cell (1,2) where there 
are three. Table 2 is the analysis 
of variance table and computa- 
tions. Note that the harmonic 
mean (3.692) and not the arith- 
metic mean (3.750) is used to 
represent the average cell size. 
Also note that by definition the 
total sum of squares is 11.733 
which in this case is not equal to 
the sum of the components. This 
discrepancy is known as 


‘Italic numbers in parentheses identify 
references on page 26. 


nonorthogonality. When cell 
sizes are equal, the sum of com- 
ponents will be equal to the sum 
of squares and orthogonality is 
preserved. Conversly orthogo- 
nality is preserved when the cell 
frequencies are equal—the sum 
of component sums of squares 
equals the total sum of squares. 


Multilinear Regression 


When the disparity among the 
cell frequencies is great, then a 
least-square solution, as in mul- 
tiple linear regression analysis, 
must be used. All computerized 
statistical packages have multiple 
linear regression routines. Before 
a multiple regression routine is 
selected, it is critical that the re- 
searcher understand the outputs 
of such a solution. Extensive lit- 
erature exists on the methods 
commonly used in dealing with 
unequal cell frequencies. (2) A 
discussion of these methods is 
not within the limits of this article. 
Examples of applying linear re- 
gression techniques to a set of 
data involving unequal cell fre- 
quencies that yield different re- 
sults are also available. (3) Fi- 
nally, guidelines are available for 
selecting one of the four types of 
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Table 3.—Analysis of variance table from example 


Source of variation Degree of freedom Sum of squares Mean squares 


One-factor 


Two-factor 


EX. Ds 
AxC 
AxD 
AXxE 
AXxF 
BG 
13}501D) 
Bx g 
BXE e 


SEKI) 
1,484.50 
18.38 
Wo 
1.45 
183.71 


11.47 
4.51 
6.42 
1.36 
0.28 

28.71 

53.62 

54.37 

81.36 


Sigafels 
80.998 

3.01 
<1.00 
<1.00 
30.07 


<1.00 
<1.00 
<1.00 
<1.00 
<1.00 
1.57 
1.46 
2.978 
4.448 


fe a 


CD 

exe 

Cx 

Dx E 

DxF 

Ex 

All three factors 
All four factors 
All five factors 
All six factors 


‘Statistically significant at the 5-percent level. 


analysis of variance tables that 
are incorporated into the SAS-76 
computer program. (4,5) 


An Example 








The analysis of variance shown 
in table 3 was taken from the 
open literature to serve as an ex- 
ample. It illustrates the inherent 
difficulty of large factorial design 
compounded by the problem of 
unequal cell frequency. In this 
table, there are six factors—A 
with two levels, B with four, C 
with two, D with three, E with 
two, and F with two. One com- 
plete replication would thus re- 
quire 2 by 4 by 2 by 3 by 2 by 2 
or 192 treatment combinations. 
Several treatment combinations 
were not observed, although it is 
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Unreported Data from Sample Study 


not known which ones are miss- 
ing. The omission of these un- 
reported two-factor interactions 
raises questions about the valid- 
ity of the analysis. Also, three of 
the unreported two-factor inter- 
action terms—C by F, D by F, 
and E by F—involve the highly 
statistically significant factor F 
(30.07). Experience shows that 
when a main factor or factors 
are highly significant, there is a 
strong possibility that an interac- 
tion term involving that single 
factor is also statistically signifi- 
cant. In this example, the two- 
factor interactions: C by F, D by 
F, and E by F are not reported. 


The two-factor interactions, B by 
E and B by F, were reported to 
be statistically significant at the 





5-percent level. The B by E in- 
teraction may be accounted for 
by random variation since the F- 
ratio was marginally significant 
with a calculated probability 
level of 04.6. Notwithstanding, 
the highly significant B factor 
calls for further analysis before 
prematurely concluding that the 
B by E interaction was random 
variation due to sampling. 


As for the B by F interaction, 
there are four levels of the B-fac- 
tor and two levels of the F-factor 
yielding a total of eight B by F 
treatment combinations. In spite 
of the statistically significant B 
by F interaction term, the author 
of the report failed to conduct 
further analysis to determine 
which treatment combinations 
differ from the others. 
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The flawed and incomplete 
analysis described above and 
illustrated in table 3 raises many 
other questions. For example, 
why are there so many missing 
observations? How many times 
was the experiment replicated? 
How valid are the results of the 
analyses of variance? Why are 
some of the two-factor interac- 
tion terms not reported? What 
is the interpretation of the statis- 
tically significant two-factor in- 
teraction terms? What are the 
practical implications of these 
statistically significant terms? 
Could the experiment be con- 
ducted on a reduced scale with 
four variables instead of six? 
Similar questions are all too 
frequently raised in readers’ 
minds at the conclusion of 
traffic study reports. 


Summary 


The analysis of variance tech- 
nique was developed and de- 
signed primarily to analyze ex- 
perimental data in a simple, 
straightforward fashion. The fac- 
torial design in the analysis of 
variance framework is a power- 
ful tool for analyzing several in- 
dependent variables simulta- 
neously. There are however, 
several practical reasons that 
tend to limit the use of high or- 
der factorial experiments. For 
example, one of the require- 
ments of factorial design is that 
each treatment combination 
(cell) must be replicated more 
than once and that the fre- 
quency of observations be equal 
for all cells. Another limitation is 
the difficulty in interpreting re- 
sults of the analysis. A high or- 
der factorial design introduces 
more sources of variation with a 
greater potential for interaction 
with other variables. This com- 
plexity means that substantive 
interpretation of the results and 
data becomes difficult and— 
possibly—misleading. 


The first of these limitations, 
logistics, is rather handily ad- 
dressed. In real-life seldom— 

if ever—are traffic studies using 
the analysis of variance tech- 
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nique conducted without miss- 
ing observations; these missing 
observations result in the prob- 
lem of unequal cell frequencies. 
Providing this disparity is not 
too great among the cells, 

there are statistical methodolo- 
gies to overcome this shortcom- 
ing while retaining a meaning- 
ful analysis. 


The second limitation, interpreta- 
tion, requires more thought to 
remedy. Based on the above, the 
factorial design may appear 
somewhat quixotic—a simple 
analytic tool of limited practical 
use because of the complexity in- 
volved in substantive interpreta- 
tion of the data collected. The 
complexity is not in the tech- 
nique, but in the phenomenon 
under investigation. In fact, it is 
rather simple to write the compu- 
tational formula for any high or- 
der factorial design once the com- 
putational formula for a two-way 
design is understood. 


Conclusions 


The aim of any research effort is 
to seek reliable information to 
questions or problems of interest. 
The first step is to define and 
identify the problem. Next, an ex- 
periment to elicit the needed in- 
formation must be designed and 
planned. In planning the experi- 
ment, the working hypothesis is 
translated into a statistical hy- 
pothesis to be evaluated from the 
data. The planning should also in- 
clude the identification of the 
amount and kind of data to be 
collected and the methodology 
for analyzing the data. Following 
conduct of the experiment, the 
final phase of the research effort 
is to interpret the data analyses 
and draw conclusions about the 
relations under study. 


Given these steps in a research 
effort, researchers must not only 
pick the right method and study 
design that suits the analysis, 
but must also complete a full 
discussion of the interpretations. 


All too frequently, authors neglect 
to explain the significance of their 


findings, instead leaving the 
reader to determine the meaning 
of statistical significance. Such 
an approach is unfair to the read- 
ers, especially those who have 
not followed the experiment from 
beginning to end; unfair to the 
data, since it leaves them essen- 
tially uninterpreted; and unfair to 
the study, since it neglects to ex- 
pand upon the practical implica- 
tions with respect to study objec- 
tives. To ensure the utility and 
comprehensibility of study find- 
ings, authors must carefully and 
thoroughly interpret their data 
and not just leave the figures in 
their “number-crunched” state. 
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Present Practices of Highway 
Transportation of Hazardous 
Materials, Publication No. 
FHWA-RD-89-013 


by IVHS Research Division 


This report summarizes the state 
of the art of safe highway trans- 
portation of hazardous materials. 
The report includes a reviews of 
literature related to safe transpor- 
tation of hazardous materials, the 
responsibilities and current prac- 
tices of government agencies, 
and current methodologies for 
establishing safe routes. The re- 
port also includes a critique of 
accident, incident, and exposure 
data bases; recommendations for 
improving the current FHWA 
routing guidelines, and recom- 
mendations for future research 
related to highway transportation 
of hazardous materials. 


Limited copies of this publica- 
tion are available from the R&D 
Report Center. Copies may also 
be purchased from the NTIS. (PB 
No. 91-124016, price code: A12.) 


Truck Characteristics for Use in 
Highway Design and Operation, 
Vol. |: Research Report, Publica- 
tion No. FHWA-RD-89-226 


by Design Concepts 
Research Division 


Highway geometric design and 
traffic operations are based in 
part on consideration of vehicle 
characteristics. Even though truck 
characteristics may be more criti- 


cal, many of the current highway 
design and operational criteria 
are based on the passenger car. 
This report reviews existing data 
for highway design, including 
truck dimensions, braking dis- 
tance, driver eye height, accelera- 
tion capabilities, soeed-mainte- 
nance capabilities on grades, 
turning radius, offtracking and 
suspension characteristics, and 
rollover threshold. 


The report also includes evalu- 
ated highway design and opera- 
tional criteria such as sight 
distances, vertical curve length, 
intersection design, critical length 
of grade, lane width, horizontal 
curve design, vehicle change 
intervals at traffic signals, sign 
placement, and highway capacity. 
An assessment and a cost analy- 
sis were made on the need to 
change the current highway 
design and operational criteria 

to accommodate trucks. 


Volume II of the report (FHWA- 
RD-89-227) contains appendixes 
documenting the detailed data 
collection and analysis activities. 


Limited copies of this publica- 
tion are available from the R&D 
Report Center. Copies may also 
be purchased from the NTIS. (PB 
No. 91-100982, price code: A12.) 
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AC Stripping Problems and 
Corrective Treatment, Publica- 
tion No. FHWA-RD-90-049 


by Pavements Division 


This study was designed to 
determine the most effective 
method of introducing lime 
into asphalt concrete mixtures, 
to improve the reliability of the 
laboratory test methods used 
to identify moisture-susceptible 
asphalt-aggregate combinations, 
and to evaluate the effective- 
ness of the recommended 
procedures using experimental 
construction projects. 


Results indicated that both tensile 
strength and resilient modulus 
are significantly controlled by the 
interaction among aggregate 
type, presence of lime and freeze- 
thaw cycles. The addition of lime 
through wet methods resulted in 
higher strengths than dry meth- 
ods, however, the difference was 
not statistically significant to sup- 
port a conclusion that wet meth- 
ods are better than dry methods. 


Limited copies of this publica- 
tion are available from the R&D 
Report Center. Copies may also 


be purchased from the NTIS. (PB 
No. 91-105924, price code: AO9.) 


Evaluation of the Supplemental! 
Procedure of the Maximum 
Specific Gravity Test for Bitumi- 
nous Paving Mixtures, Publica- 
tion No. FHWA-RD-90-082 


by Pavements Division 


Performed in the Federal High- 
way Administration Bituminous 
Mixtures Laboratory located at 
the Turner-Fairbank Highway Re- 
search Center, McLean, Virginia, 
this study investigated the effects 
of performing the supplemental 
procedure of AASHTO T 209 (or 
ASTM D 2041). Using both thor- 
oughly coated aggregates and 
partially coated aggregates, the 
procedure was performed to de- 
termine its effects on the percent 
air voids, effective specific gravity 
of the aggregate, and the maxi- 
mum specific gravity of a bitumi- 
nous paving mixture. 


The supplemental procedure 
should correct the test data for 
water absorbed into the aggre- 
gate during the test. Although 
the supplemental procedure can 
be used when designing mix- 


tures, it is most often used for 
determining the maximum spe- 
cific gravities of moisture dam- 
aged pavement samples, or 
cores or specimens where saw- 
ing has exposed a significant 
amount of aggregate. The ma- 
jority of aggregates used in this 
study had water absorptions be- 
low 2.5 percent and thus were 
not highly absorptive. 


It is recommended that the 
supplemental procedure not be 
performed on laboratory mix- 
tures or pavement cores having 
aggregates with water absorp- 
tions below 2.5 percent. When 
testing any mixture prepared in 
the laboratory during the mix- 
ture design process, the proce- 
dure for determining the maxi- 
mum specific gravity should 
only be performed on well- 
coated mixtures so that the 
supplemental procedure does 
not have to be used. For highly 
absorptive aggregates, it is rec- 
ommended that the test only be 
performed at high binder con- 
tents which provide thick coat- 
ings. Only binder contents close 
to optimum should be used. The 
maximum specific gravities for 
the lower binder contents can be 
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calculated using the effective 
specific gravity of the aggregate. 
For laboratory mixtures contain- 
ing highly absorptive aggre- 
gates, the supplemental proce- 
dure may indicate whether the 
coating is sufficient. 


Limited copies of this publica- 
tion are available from the R&D 
Report Center. Copies may also 
be purchased from the NTIS. (PB 
No. 91-124065, price code: A03.) 


Work Zone Traffic Control Delin- 
eation for Channelization, Publi- 
cation No. FHWA-RD-90-089 


by Information and Behavioral 
Systems Division 


This report describes a study of 
the delineation requirements for 
work zone traffic control. The re- 
search included a comprehen- 
sive review of past studies and 
Current practices, and an exami- 
nation of current standards. It 
was concluded that, in spite of 
the increasing number of differ- 
ent types of channelizing de- 
vices, there appears to be no 
scientific basis for the spacing 
criteria in the taper or tangent 
sections of a work zone. 


A laboratory-based testing pro- 
cedure was used to determine 
the most appropriate spacing 
configuration. An interactive 
video system was used to test 
subject recognition distances of 
eight different device types 
spaced at the standard distance, 
1.5 times, and 2.0 times the stan- 
dard distance. Over 240 sub- 
jects, were tested. The results 
showed bigger devices were 
more visible than smaller ones 
and indicated better the nature 
of the delineation. The spacing 
of devices, however, did not 
have a significant effect. In 
lesser reflectivity areas, there 
should be closer spacing. 


Field testing was undertaken at 
six actual work zones. Right and 
left lane closures were used to 
test the various device-spacing 
configurations, under both day 
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and night conditions. Manual and 
automated methods were used to 
gather the field data for traffic ap- 
proaching a work zone. The study 
area included four points equally 
spaced over the 2,000 ft (600 m) 
before the work zone and the ac- 
tivity at the start of the taper for 
the lane closure. The tests were 
performed under the hypothesis 
that the most effective treatment 
would minimize the percentage of 
traffic in the closed lane at the 
start of the taper. 


Field data were analyzed for 2,100 
4-minute observation periods. 
Statistical analysis of the data de- 
termined neither type of device 
(round barrels, oblong barrels, 
Type Il barricades, and cones with 
reflectorized collars) or device 
spacing (55, 80, and 110 ft) [16.5, 
24.7, 33.0 m] had a significant ef- 
fect on driver lane changing be- 
havior. An arrow panel was oper- 
ating at all lane closure sites 
which seemed to override any ef- 
fects of the delineation devices. 
Recommendations for locating 
work zones to maximize the sight 
line on the approach to the taper 
are presented. 


Limited copies of this publica- 
tion are available from the R&D 
Report Center. Copies may also 
be purchased from the NTIS. (PB 
No. 91-124107, price code: A06.) 


Performance of Jointed 
Concrete Pavements, 
Vol.|: Evaluation of Concrete 
Pavement Performance 
and Design Features, 
Publication No. FHWA- 
RD-89-136, 
Evaluation and Modifi- 
cation of Concrete 
Pavement Design 
Analysis Models, Publi- 
cation No. FHWA-RD- 
89-137, 
Vol. Ill: Summary of Research 
Findings, Publication 
No. FHWA-RD-89-138, 
Vol. IV: Appendix A: Project 
Summary Reports and 
Summary Tables, Publi- 
cation No. FHWA-RD- 
89-139, 


Vol. Il: 


Vol. V: Appendix B: Data Col- 
lection and Analysis 
Procedures, Publication 
No. FHWA-RD-89-140, 

Vol. VI: Appendix C: Synthesis 
of Concrete Pavement 
Design Methods and 
Analysis Models; Ap- 
pendix D: Summary of 
Analysis Data for the 
Evaluation of Predictive 
Models, Publication No. 
FHWA-RD-89-141 


by Pavements Division 


This series of reports documents 
the findings of a comprehensive 
study of the effect of various 
design features on the perfor- 
mance of jointed concrete pave- 
ments. The effect on perfor- 
mance of slab thickness, base 
type, slab length, reinforcement, 
joint orientation, load transfer, 
dowel coating, longitudinal joint 
design, joint sealing, widened 
lanes, and subdrainage is dis- 
cussed. The findings are based 
on data collected from 95 pave- 
ment section located around the 
country. Well-documented envi- 
ronmental and traffic analyses 
help to isolate the effect of these 
design features. 


Also presented is an evaluation 
of 11 currently used models for 
concrete pavement design, 
analysis, and performance pre- 
diction. This evaluation was per- 
formed using data from the vari- 
Ous pavement sections. It was 
found that none of the models 
were able to adequately model 


' the performance of these 


inservice pavements. 


New prediction models for 
present serviceability rating, 
joint faulting, transverse crack- 
ing, and transverse joint spalling 
were developed. An evaluation 
of the cost effectiveness of se- 
lected pavement design features 
was also made. 


Limited copies of this publica- 
tion are available from the R&D 
Report Center. Copies may also 
be purchased from the NTIS. (PB 
No. PB-91-100511 for set of RD- 
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89-136 to 141. RD-89-136 PB-91- 
100529 A10; RD-89-137 PB-91- 
100537 A14; RD-89-138 PB-91- 
100545 A08; RD-89-139 PB-91- 
100552 A13; RD-89-140 PB-91- 
100560 A08; RD-89-141 PB-91- 
100578 A17.) 


Structural Overlay Strategies for 

Jointed Concrete Pavements, 

Vol. | Sawing and Sealing of 
joints in AC Overlays of 
Concrete Pavements, 
Publication No. RD-89- 
142, : 


Vol. ll Cracking and Seating of 
Concrete Slabs Prior to 
AC Overlay, Publication 
No. FHWA-RD-89-143, 

Vol. lll Performance Evaluation 


and Analysis of Thin 
Bonded Concrete 
Overlays, Publication 
No. FHWA-RD-89-144, 
Vol. IV Guidelines for Selection 
of Rehabilitation Alter- 
natives, Publication No. 
FHWA-89-145, 
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Vol. V Summary of Research 
Findings, Publication 
No. FHWA-89-146, 

Vol. Vi Appendix A-Users 
Manual for the EXPEAR 
Computer Program, 
Publication No. FHWA- 
RD-89-147, 


by Pavements Division 


This series of reports documents 
an extensive field study and 
evaluation of three structural 
overlay strategies for jointed 
concrete pavements. The perfor- 
mance of these different reha- 
bilitation strategies is docu- 
mented and guidelines on their 
applicability are presented. Spe- 
cific construction recommenda- 
tions for each strategy are also 
discussed. 


Volume IV presents practical 
guidelines on the selection of re- 
habilitation strategies for jointed 
concrete pavements, including 


selecting among structural over- 
lay types and choosing among 
other restoration and rehabilita- 
tion alternatives. 


Volume V is asummary of the 
research findings. Volume Vl is a 
Users Manual for the advisory 
system EXPEAR which is used to 
help select the most appropriate 
concrete pavement rehabilita- 
tion strategy. It is an excellent 
training tool. 


Limited copies of this publica- 
tion are available from the R&D 
Report Center. Copies may also 
be purchased from the NTIS. (PB 
No. PB-91-100586 for set of RD- 
89-142 to 147. RD-89-142 PB-91- 
100594 A07; RD-89-143 PB-91- 
100602 A08; RD-89-144 PB-91- 
100610 A0O9; RD-89-145 PB-91- 
100628 A05; RD-89-146 PB-91- 
100636 A05; RD-89-147 PB-91- 
100644 A04.) 
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The following are brief descrip- 
tions of selected items that 
have been completed recently 
by State and Federal highway 
units in cooperation with the 
Office of Safety and System 
Applications and the Office of 
Research and Development 
(R&D), Federal Highway 
Administration. Some items 
by others are included when 
they are of special interest to 
highway agencies. All publica- 
tions are available from the 
National Technical Information 
Service (NTIS). In some cases, 
limited copies of publications 
are available from the R&D 
Report Center. 


When ordering from the NTIS, 
include the PB number (or the 
publication number) and the 
publication title. Address 
requests to: 


_ National Technical 
Information Service 
5285 Port Royal Road 
Springfield, Virginia 22161 


Requests for items available 
from the R&D Report Center 
should be addressed to: 


Federal Highway 
Administration 

R&D Report Center, HRD-11 
6300 Georgetown Pike 
McLean, Virginia 22101-2296 
Telephone: (703) 285-2144 
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Asphalt Content Determination 
Manual, Publication No. FHWA- 
IP-90-008 


by Office of Technology 
Applications 


This report examines the assess- 
ment procedures for evaluating 
an asphalt concrete mixture and 
evaluates the suitability of updat- 
ing current procedures and equip- 
ment. Current test requirements 
call for the asphalt content and 
gradation to be compared with 
specifications to certify the level 
of quality in the mixture. Newer 
techniques include the nuclear as- 
phalt content (NAC) gauge, the 
use of biodegradable solvents, 
and determination of gradation 
from cold feed testing. The evalu- 
ation of State experience and spe- 
cial studies, and analysis of raw 
data collected by various State 
agencies provided supporting 
data that show the NAC gauge 
can be substituted for traditional 
extraction tests for asphalt con- 
tent determination. 


Several of the new biodegrad- 
able solvents can be substituted 
directly for traditional ones with 
the same level of accuracy in as- 
phalt content determination. 
When special procedures were 
used to account for fines re- 
moved during rinsing opera- 
tions, biodegradable solvents 
did not produce a consistently 
different gradation. 


It is recommended that the bio- 
degradable solvents be used in 
conjunction with the NAC 
gauges to provide a more eco- 
nomical means of evaluating an 
asphalt concrete mixture. A 
number of studies examining 
cold feed determination indicate 
that the cold feed gradations are 
as accurate, and no more vari- 
able than the determination of 
gradation in place or from the 
delivery system. The durability 
of the aggregate can alter this if 
it degrades during production, 
producing a different gradation 
on the roadway. 


This publication may only be pur- 
chased from the NTIS. (PB No. 91- 
125443, price code: A05.) 


Highway Subdrainage Design by 
Microcomputer: (DAMP) Drain- 
age Analysis and Modeling 
Programs 1.1, Publication No. 
FHWA-IP-90-012 


by Office of Technology 
Applications 


This report presents the users 
manual and technical guide for 
the software program, DAMP 
(Drainage Analysis and Model- 
ing Programs), designed to per- 
form drainage design for high- 
ways by microcomputer. This 
program includes a comprehen- 
sive examination of the drainage 
factors which affect pavement 
design and performance. The 
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following modules are included: 
a) determination of net inflow by 
surface infiltration, ice lensing, 
and an evaluation of pavement 
geometry affecting outflow of 
water, b) determination of the 
AASHTO drainage coefficients 
using base drainage times, and 
climatic saturation moisture cal- 
culations, c) an edge drain 
analysis of pipe drains, 
geocomposite fin drains, and 
granular trenches, d) drainage 
layer analysis using calculated 
permeability and thicknesses, 
and e) filtration analysis using 
granular material gradations and 
filter fabric evaluation. 


These calculation modules have 
been programmed into a user 
interactive program which allow 
the user to use any module inde- 
pendently of the others to per- 
form sensitivity analyses. Con- 
text sensitive help is provided 
and graphical help screens are 
included where necessary. The 
program has the ability to per- 
form batch calculations and 
print results directly to a disk 
file or a printer. 


This publication may only be 
purchased from the NTIS. (PB 
No. 91-128272, price code: AO6.) 
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Evaluation of the PAVEDEX Road 
Survey System in lowa, Publica- 
tion No. FHWA-TS-90-038 


by Materials Division 


The lowa Department of Trans- 
portation (DOT) evaluated the 
PAS | Road Survey System that 
uses video photography to iden- 
tify and quantify pavement 
cracking and patching dis- 
tresses. Comparisons were 
made to procedures currently 
used in the State. 


Interstate highways, county 
roads, city streets, and two 
shoulder sections were evalu- 
ated. Variables included travel 
speeds, surface type and tex- 
ture, and traffic control condi- 
tions. Repeatability and distress 
identification were excellent 

on rigid pavements. Differences 
in distress identification and 
the effect of surface textures in 
the flexible test sections limited 
the repeatability and correlation 
of data to that of the lowa 

DOT method. 


Cost data indicates that 
PAVEDEX is capable of provid- 
ing results with improved accu- 
racy at a reasonable cost, but in 
excess of that experienced cur- 
rently by the lowa DOT. 
PAVEDEX is capable of provid- 
ing network level pavement con- 
dition data at highway speeds 


Superintendent of Documents Subscriptions Order Form 


The total cost of my order is $ . Price includes regular domestic postage and handling and is subject to change. 


Please Choose Method Of Payment: 
i Check payable to the Superintendent of Documents 


L_] Gpo Deposit Account 
[_] VISA or MasterCard Account 


(Credit card expiration date) 








(Signature) 





YES NO Mail To: Superintendent of Documents, Government Printing 
Office, Washington, DC 20402-9371 





To fax your orders and inquiries-(202) 275-0019 
te YES, please send me subscriptions to PUBLIC ROADS, PR, at $6.00 each ($7.50 foreign) per year, 


and analysis of the data to iden- 
tify 1/8-in (3.2 mm) cracks at ap- 
proximately 2 to 3 lane mi (1.6 
km) per hour with manual evalu- 
ation. Photologging capability is 
also included in the unit. 


This publication may only be 
purchased from the NTIS. (PB 
No. 91-124073, Price code: A06.) 


Pavement Management at the 
Local Government Level, Publi- 
cation No. FHWA-TS-90-042 


by Office of Technology 
Applications 


Local governments are making 
considerable efforts to implement 
pavement management systems. 
Sponsored by the State of Califor- 
nia Department of Transportation 
and the Federal Highway Admin- 
istration through the Rural Tech- 
nical Assistance Program (RTAP), 
this study surveyed and evalu- 
ated the experiences of 13 agen- 
cies that initiated the develop- 
ment of a pavement management 
system (PMS). The report sum- 
marizes the results of the study 
and includes a discussion of fac- 
tors to be considered for a local 
government PMS. 


As a result of the survey and ini- 
tial findings, six local govern- 
ment agencies were provided 
both financial and technical as- 
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sistance to implement pavement 
management activities within 
their organizations. 


The results suggest that the de- 
velopment of a generic pavement 
management system would be 
desirable. This generic system 
might be developed inhouse or 
with the assistance of a consult- 
ant. Included in the report is a 
brief discussion of the form that 
such a system might take and the 
stages of its development. 


Limited copies of this publication 
are available from the R&D Re- 
port Center. Copies may also be 
purchased from the NTIS. (PB No. 
91-124081/AS, price code: A04.) 


Workshop on Field Inspection 
and Rehabilitation of Traffic 
Control Devices, Proceedings, 
Publication No. FHWA-TS-90-048 


by Office of Technology 
Applications 


The Federal Highway Adminis- 
tration has begun a number of 
initiatives to improve signing on 
the Nation’s roadways. These in- 
clude workshops to obtain input 
from experts across the country, 
a review of each State’s highway 
sign replacement and refurbish- 
ing program, and a training 
course. This report documents 
the proceedings of two work- 
shops and details the remarks 
made by the panelists and the 
comments and concerns of the 
participants on each issue. 


Limited copies of this publication 
are available from the R&D Re- 
port Center. Copies may also be 
purchased from the NTIS. (PB No. 
91-108605/AS, price code: A11.) 


Open Roads: A Look at Freeway 
Incident Management, Publica- 
tion (videotape) No. FHWA-SA- 
91-011 


This 20-minute video program 
presents—in clear, nontechnical 
language—the current state 

of the practice of freeway inci- 
dent management and is in- 
tended for viewing by top- 
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OPEN ROADS: 


a look at 
FREEWAY INCIDENT 
MANAGEMENT 


Moving America 
Into the 21st Century 


level management, elected 
officials, citizen groups, and 
other interested parties. 


Through an effective mix of ani- 
mation, special effects, on-cam- 
era interviews, and real-world 
video footage, this video program 
dramatically depicts the severity 
of the incident problem, then of- 
fers effective and practical solu- 
tions. In doing so, it touches upon 
a broad range of proven, success- 
ful incident management strate- 
gies—including many simple, 
low-cost procedures that can be 
readily adopted. 


Loan copies may be obtained by 
contacting: 

Mr. Keith J. Harrison 

Federal Highway Administration 
Office of Traffic Operations 

and IVHS 

Traffic Operations Division 
(HTV-31) 





400 Seventh Street, S.W. 
Washington, DC 20590 
(202) 366-2250 


Copies will be available for pur- 
chase from: 
Institute of Transportation 


‘ Engineers 


525 School Street, S.W. 
Suite 410 

Washington, DC 20024-2729 
(202) 554-8050 


GPO Subject Bibliography 


To get a complete free listing of 
publications and periodicals on 
highway construction, safety, 
and traffic, write to the Superin- 
tendent of Documents, Mail 
Stop : SSOP, Washington, D.C. 
20402-9328, and ask for Subject 
Bibliography SB-03 Highway 
Construction, Safety, and Traffic. 
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Publications 


Annual Report: Office of Re- 
search, Development, and 
Technology 1990, Publication 
No. FHWA-RD-90-107 


The Office of Research, Develop- 
ment, and Technology (RD&T) 
has released its 1990 annual re- 
port. This report is a continuation 
of the series of annual and bien- 
nial reports published since 1974. 


For fiscal year 1990—October 
1989 through September 1990— 
the report covers exclusively the 
offices of research, develop- 
ment, and technology housed at 
the Turner-Fairbank Highway 
Research Center. Along with an 
overview of the research center, 
this report includes summaries 
of the various research pro- 
grams managed or performed 
by the staff. The back section in- 
cludes a list of research and de- 
velopment publications for 1990. 


While supplies last, individual 
copies of the reports in the se- 
ries are available without charge 
from the Federal Highway Ad- 
ministration, R&D Report Center, 
HRD-11, 6300 Georgetown Pike, 
McLean VA 22101-2296. Tele- 
phone: (703) 285-2144. 


Nationally Coordinated Program 
of Highway Research, Develop- 
ment, and Technology: Annual 
Progress Report, Executive 
Summary, Fiscal Year 1990, 
Publication No. FHWA-RD-90-109 
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This executive Summary gives an 
overview of progress being made 
under the Nationally Coordinated 
Program (NCP) of Highway Re- 
search, Development, and Tech- 
nology during the period from 
October 1, 1989 through Septem- 
ber 30, 1990. The Office of RD&T 
uses the NCP as a management 
framework for highway research 
activities. The objectives of the 
NCP are to: 


* Ensure resource concentration 
on critical problems. 

¢ Minimize duplicated efforts 
among researchers. 


* Identify and highlight gaps in 
research. 


This report covers technologies 
for highway design, construction, 
and operations including the spe- 
cific categories of: Highway 
Safety, Traffic Operations, Pave- 
ments, Structures, Materials and 
Operations, Policy and Planning, 
and Motor Carrier Transportation. 


Limited copies of this Executive 
Summary are available from the 
R&D Report Center, HRD-11, 
6300 Georgetown Pike, McLean 
VA 22101-2296. Telephone: 
(703) 285-2144. 
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